Search for: All records

Dispositions are valued by employers and promoted by recent computing curricular recommendations. Yet, fostering and assessing dispositions are not well understood. In a multi-institutional study, students were asked to assess their dispositions in terms of behaviors that were identified in prior literature for those dispositions, both at the start and the end of a term. During the term, instruments were used to have students reflect on their dispositions. The research questions of the study are: 1) Do students associate behaviors with the dispositions for which they were identified in prior work? 2) Does reflecting on dispositions change how students assess themselves in terms of the behaviors? and 3) Is there a difference between introductory and upper-level students in how they assess themselves in terms of the behaviors? The findings of the study are that 1) at least 60% of the students associated the behavior statements with the dispositions for which they were identified; 2) students lowered their self-assessment of some behaviors after reflecting on dispositions; and 3) upper-level students assessed themselves more positively on some behaviors than introductory students. These results support a model of development of dispositions in which self-assessment of behaviors associated with dispositions improves with academic level, but at each level, gets revised lower after reflection. 

Lifelong learning is essential in computing, given the dynamic nature of the field. Employers and curricular reviewers recognize the value of being self-directed in support of becoming a lifelong learner. The ACM/IEEE-CS Computing Curricula 2020 report identifies self-directed as having elements of self-motivation, determination, and independence. Little is known, however, about how to cultivate this disposition in computing courses. The motivation of this study is to better understand what behaviors computing students believe are self-directed. This study’s research questions are: 1) What do students describe as their self-directed practices in computing? and 2) What do students report are factors that prevent them from being self-directed? Assignments in five undergraduate computing courses from four institutions included prompts to elicit student’s reflections on how they were self-directed (or not). Thematic content analysis using the constant comparative method produced eight categories of self-directed behaviors (utilizing external resources, learning necessary material, working independently, assessing oneself, planning ahead, applying useful techniques, completing the assigned work, and reviewing against expectations). Thematic analysis also resulted in five categories of factors that impeded the self-directed behavior (assignment structure, unsuccessful effort, self-sufficiency, insufficient motivation, and insufficient time). Understanding how students describe self-directedness can help educators design pedagogical and assessment approaches that facilitate self-directed student behaviors in the classroom. 

Code quality is of universal concern among educators. Refactoring code, i.e., revising the structure of a program without changing its behavior is one approach for improving code quality. Numerous software tools have been created to help students refactor the code they write. Only a few software tutors have been reported in literature that help students proactively learn code quality by solving refactoring problems. But they suffer false positive and false negative grading issues because they allow freehand coding. We investigated whether refactoring tutors that do not allow freehand coding could be used to help students learn about non-trivial anti-patterns. We developed and deployed two software tutors for refactoring problems that are based on the principle of “refactoring without rewriting code”, and cover a subset of refactoring problems that can be solved using only deletion, duplication, reordering and token-wise editing of lines of code. We investigated whether students needed to learn the anti-patterns covered by the tutors and whether they benefited from using the tutors. In this experience report, we start by describing the tutors – the list of refactoring concepts covered, the user interface, grading, feedback and usage. We report our experience using the tutors over three semesters, which confirmed that both introductory and advanced students needed and benefited from using the tutors despite the limitations of the tutors’ coverage. We reflect on what worked and what did not. The tutors currently cover C++, Java and C#. They are available for free for educational use on the web at auglets.org. 

This full research paper contributes to current work on fostering professional dispositions in computing and engineering education by identifying the categories of behaviors that students associate with dispositions while doing course work. Professional dispositions, demonstrated through desirable behaviors in the workplace, such as being persistent or self-directed, are explicitly sought by employers. Fostering dispositions among students has been identified in various curricular recommendations as an important goal. In prior work, the authors used reflection exercises, in which students were presented with the definition of a disposition and asked to answer an open-ended reflection prompt on how they applied the disposition in their own work. Thematic analysis of student responses to reflection exercises resulted in categories of behaviors that students associated with dispositions. In the work discussed in this paper, the authors used vignette exercises to collect and analyze similar data and gain further insight into behavioral categories and students’ perceptions of dispositions. Vignettes include short scenarios that demonstrate the application of dispositions in real life. A vignette exercise involves students reading a vignette scenario, identifying the disposition demonstrated by the scenario, and answering the same open-ended reflection prompt as in the reflection exercises from the earlier studies. The research question for this study is: Which behavioral categories obtained from analyzing student responses to reflection exercises were confirmed using vignette exercises (and which were not confirmed), and which behavioral categories were refined? To answer this question, researchers from four different institutions of higher education collected data in multiple courses over two semesters. The student open-ended responses to vignettes were thematically analyzed to identify behavioral categories for four dispositions: collaborative, meticulous, persistent and self-directed. The ultimate goal of this work is to create classroom interventions and learning activities that foster dispositions among students based on behavioral categories. This study supports this goal in two ways. It provides another iteration of behavioral category analysis and introduces vignettes to encourage students to reflect candidly and communicate clearly how they apply dispositions in terms of behaviors. The study results and their implications for fostering dispositions in a classroom setting are presented and discussed. 

Dispositions, skills, and knowledge form the three components of competency-based education. Moreover, dispositions are considered crucial for students to succeed in the workplace. Few studies investigate how dispositions manifest in the form of observable behaviors, which causes challenges for both students and educators. Computing students, for example, may not understand what is expected of them, and how to achieve dispositions. This paper presents the results of a qualitative, multi-institutional study on students’ understanding of the dispositions adaptable, persistent, self-directed, meticulous, and professional. Perceptions were gathered by asking for exemplary situations of students applying each of the five dispositions in the context of assignments within computing courses. Students who indicated they did not apply the disposition were asked to describe the hindering circumstances. The data was evaluated by using Mayring’s content analysis technique, resulting in the development of deductive-inductive categories of observable behaviors reflecting the student’s perspective. For meticulous and professional, new categories representing observable behaviors were developed. For adaptable, persistent, and self-directed, the authors confirmed and extended prior work. Moreover, factors hindering students in applying the investigated dispositions are identified. The resulting categories with observable student behaviors are an important step toward the operationalization of competency-based learning outcomes including dispositions. A common understanding of dispositions will also help with the design of new forms of instruction and measures to foster the application of dispositions in the context of computing education. 

There can be many conflicting goals for the design of a computer science curriculum including: immediate employability in industry, preparation for long-term success in an ever-changing discipline and preparation for graduate (that is, post-graduate) study. Emphasis on immediate employability may lead to prioritizing current tools and techniques at the expense of foundational and theoretical skills as well as broader liberal-arts education that are crucial to long-term career success and for graduate study. The implications of these conflicting goals include allocation of finite resources (time, courses in the curriculum), unwillingness of students to invest in the mathematics that they see as irrelevant to their immediate career goals, and reluctance of faculty to have their courses driven by a continually evolving marketplace of tools and APIs. A balanced curriculum benefits all stakeholders: students, employers, and faculty. Would a data-driven approach help faculty design curricula that effectively balance these multiple goals? For example, if we ask graduates of computer science programs to reflect on the impact of their undergraduate education, explicitly focusing on short and long-term impact, will there be enough meaningful data to significantly inform curricular design? A recent survey of industry professionals undertaken by the ACM/IEEE-CS/AAAI 2023 Computer Science Curricular Task Force (CS2023) points the way. This column presents one aspect of that survey—a focus on comparing short-term versus long-term views—and calls for similar surveys of industry professionals to be conducted on an ongoing basis to refine our understanding of the role played by various elements of undergraduate computer science curricula in the success of graduates. 

Vignettes are short stories along with a set of questions that engage the reader to comment on the story. Vignettes have been used in professional academic programs (e.g., teacher preparation and medical education), for professional development in various fields (e.g., teaching ethics in psychology and medicine), and in various research fields for data collection. In this work, vignettes are used to elicit students' understanding of dispositions in computing education. Professional dispositions enable behaviors that are valued in the workplace, such as adaptability or self-directedness. They are often explicitly stated in computing job postings. While the relevance of dispositions is widely recognized in the workplace, only recently have curricular guidelines for computing programs recognized professional dispositions as an integral part of competencies and as complementary to knowledge and skills. There is scarce literature on the use of vignettes in teaching undergraduate computing, or on how best to foster dispositions in students. In this project, four faculty from four diverse institutions in the U.S., along with three consulting experts, have collaborated to design and evaluate the use of vignettes in the classroom. This paper documents researchers' efforts to gain insights into students' perceptions of dispositions through the use of vignettes. Such insights may guide educators to identify pedagogical strategies for fostering dispositions among students. This paper presents an iterative process for vignette design with continuous review by researchers and focus group members. The vignettes in this study use stories of situations which demonstrate the application of a disposition, drawn from various fields and walks of life to represent diverse groups and experiences. Students are presented with the vignette story and asked to identify the disposition illustrated. To elicit students' understanding of dispositions in terms of their personal behaviors, students are asked to describe a situation in which they have experienced the disposition. Lessons learned in the design and use of vignettes are discussed. 

Dispositions, along with skills and knowledge, form the three components of competency-based education. Moreover, studies have shown dispositions to be necessary for a successful career. However, unlike evidence-based teaching and learning approaches for knowledge acquisition and skill development, few studies focus on translating dispositions into observable behavioral patterns. An operationalization of dispositions, however, is crucial for students to understand and achieve respective learning outcomes in computing courses. This paper describes a multi-institutional study investigating students’ understanding of dispositions in terms of their behaviors while completing coursework. Students in six computing courses at four different institutions filled out a survey describing an instance of applying each of the five surveyed dispositions (adaptable, collaborative, persistent, responsible, and self-directed) in the courses’ assignments. The authors evaluated data by using Mayring’s qualitative content analysis. The result was a coding scheme with categories summarizing students’ concepts of dispositions and how they see themselves applying dispositions in the context of computing. These results are a first step in understanding dispositions in computing education and how they manifest in student behavior. This research has implications for educators developing new pedagogical approaches to promote and facilitate dispositions. Moreover, the operationalized behaviors constitute a starting point for new assessment strategies of dispositions.